Display control device, display control method, search device, search method, program and communication system

ABSTRACT

An information processing apparatus may include a control unit to control display of parts information of a plurality of items, to generate search information according to feedback from a user for the parts information, and to control display of a search result according to the search information.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.14/492,610, filed Sep. 22, 2014, which is a continuation of U.S.application Ser. No. 13/396,911, filed Feb. 15, 2012, which claimspriority from Japanese Patent Application No. 2011-035886, filed in theJapan Patent Office on Feb. 22, 2011, and Japanese Patent ApplicationNo. 2011-035887, filed on Feb. 22, 2011, the entire contents of whichare hereby incorporated by reference.

FIELD

The present disclosure relates to a display control device, a displaycontrol method, a search device, a search method, a program and acommunication system, and more particularly, to a display controldevice, a display control method, a search device, a search method, aprogram and a communication system which are capable of providing adesired search result to a user on the basis of a small amount offeedback of the user, for example.

BACKGROUND

For example, an image search system exists in which an image desired bya user (hereinafter, referred to as a desired image) is retrieved from aplurality of images stored in a large capacity recording medium (forexample, a hard disk or the like).

In this image search system, the user selects an inquiry image which ismost similar to the desired image from a plurality of inquiry imagespresented by the image search system. Further, the image search systempresents an image having an image feature amount which is closest to animage feature amount of the selected inquiry image among a plurality ofimages to the user as the desired image which is most similar to theselected inquiry image.

However, in this image search system, in a case where a semantic gap islarge, it is difficult to provide the search result which the userdesires. Here, the semantic gap refers to a difference generated betweenan image feature amount used for searching the desired image and aconcept used when a person actually recognizes the desired image.

That is, in a case where a large gap is present between the similarityof images determined by a person and the similarity of images determinedby the image search system, it is difficult to provide the desired imageas the search result in the image search system.

In this regard, a classifier search technique exists which searches adesired image, for example, using a classifier which performs search tomatch recognition that a person is capable of, in order to reduce asemantic gap. The classifier is generated in advance by performingstatistic learning as teacher data of a large amount of image dataobtained by adding a label indicating the similarity to the desiredimage by a person.

According to this classifier, it is possible to reduce the semantic gapand to obtain a search result relatively desired by a user.

However, according to the above-described classifier, in a case where aplurality of users selects the same inquiry image, the same searchresult is provided to all the users, which may not be a desired searchresult to all the plurality of users.

This is because the similarities of images determined by the pluralityof different users are different from each other. That is, for example,a first user may feel that the selected inquiry image is similar to animage Q1 and an image Q2 but is not similar to an image Q3. On the otherhand, a second user different from the first user may feel that theselected inquiry image is similar to the image Q1 and the image Q3 butis not similar to the image Q2.

In this regard, a fit feedback technique has been proposed whichenhances the search accuracy of a desired image by generating aclassifier which matches user recognition on the basis of feedback froma user, for each user (for example, refer to JP-A-10-40268,JP-A-2003-228581 and JP-A-2008-276775).

SUMMARY

In the fit feedback technique as described above, the feedback of apredetermined amount or more should be performed in order to enhance thesearch accuracy of the desired image on the basis of the feedback fromthe user.

Thus, there is a need for the user to perform feedback of thepredetermined amount or more for the image search system, which isbothersome for the user.

Further, for example, in a case where the feedback from the user doesnot reach the predetermined amount, it is difficult to enhance thesearch accuracy of the desired image.

Accordingly, it is desirable to provide a technique which is capable ofsearching a desired search target from a plurality of search targetswith high accuracy even in a case where the amount of the feedback fromthe user is small.

In accordance with one embodiment, an information processing apparatusmay include a control unit to control display of parts information of aplurality of items, to generate search information according to feedbackfrom a user for the parts information, and to control display of asearch result according to the search information.

In accordance with another embodiment, a search device may include acontrol unit to control a search of some items based on feedbackinformation from a user for displayed parts information of a pluralityof items, where the feedback information indicates whether a partinformation of at least one of the items is fit for a user preference.

In accordance with another embodiment, a method of informationprocessing may include controlling, by a processor, display of partsinformation of a plurality of items, to generate search informationaccording to feedback from a user for the parts information, and displayof a search result according to the search information.

In accordance with another embodiment, a method of search may includecontrolling, by a processor, a search of some items based on feedbackinformation from a user for displayed parts information of a pluralityof items, where the feedback information indicates whether a partinformation of at least one of the items is fit for a user preference.

In accordance with another embodiment, anon-transitory recording mediummay be recorded with a computer readable program executable by acomputer. The program may include controlling display of partsinformation of a plurality of items, to generate search informationaccording to feedback from a user for the parts information, and displayof a search result according to the search information.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an example of a configuration ofa communication system according to an embodiment of the presentdisclosure;

FIG. 2 is a diagram illustrating an example of a table stored in aclassifier shared server;

FIG. 3 is a block diagram illustrating an example of a configuration ofa user terminal;

FIG. 4 is a diagram illustrating an example of a display screenreferenced at the time of product purchase;

FIG. 5 is a diagram illustrating an example of a display screenreferenced at the time of feedback;

FIG. 6 is a flowchart illustrating an example of a display controlprocess performed by a user terminal;

FIG. 7 is a block diagram illustrating an example of a configuration ofa shop server;

FIG. 8 is a diagram illustrating statistic learning of a classifierusing an SVM;

FIG. 9 is a diagram illustrating an example of a calculating method of atarget fit;

FIG. 10 is a diagram illustrating an example of a calculating method ofa part fit when a part image is not present;

FIG. 11 is a diagram illustrating an example when a weight multiplied bypart fit is changed;

FIG. 12 is a flowchart illustrating an example of a first fitcalculation process performed by a shop server;

FIG. 13 is a flowchart illustrating an example of a second fitcalculation process performed by a shop server;

FIG. 14 is a diagram illustrating an example of a display screen when apart is added or deleted; and

FIG. 15 is a block diagram illustrating an example of a configuration ofa computer.

DETAILED DESCRIPTION

Hereinafter, mode of implementing the present disclosure (hereinafter,referred to as embodiment) will be described in the following order.

1. Present embodiment (example when a product is purchased from aninternet site)

2. Modification

1. Present Embodiment

[Configuration Example of Communication System 1

FIG. 1 illustrates a configuration example of a communication system 1according to the present embodiment.

The communication system 1 includes user terminals 21 ₁ to 21 _(N), anetwork 22 such as the Internet, shop servers 23 ₁ to 23 _(M), and aclassifier shared server 24.

Hereinafter, in a case where it is not necessary to distinguish therespective user terminals 21 ₁ to 21 _(N), the user terminal is simplyreferred to as a user terminal 21 _(n). Further, in a case where it isnot necessary to distinguish the respective shop servers 23 ₁ to 23_(M), the shop server is simply referred to as a shop server 23 _(m).

The user terminal 21, receives GUI (Graphical User Interface)information from the shop server 23 _(m), as the user terminal 21 _(n)accesses the shop server 23 _(m) through the network 22. Further, theuser terminal 21 _(n) displays a part image indicating each part ofproducts (for example, clothes or the like) which are available in theshop server 23 _(m), on the basis of the GUI information from the shopserver 23 _(m). The GUI information refers to information forcontrolling a display by the user terminal 21 _(n).

Further, the user terminal 21 _(n) generates part preference informationindicating a user preference for each part according to a feedbackoperation of a user, and feeds back the part preference information tothe shop server 23 _(m) through the network 22. Details about the userterminal 21 _(n) will be described later with reference to FIGS. 3 to 6.

The shop server 23 _(m) is a server which serves as an internet shop forproduct sale, for example. The shop server 23 _(m) generates GUIinformation for displaying a part image for each of a plurality ofproducts for sale according to access from the user terminal 21 _(n) andsupplies the generated GUI information to the user terminal 21 _(n)through the network 22, for example.

Further, the shop server 23 _(m) searches a user desired product (forexample, a product or the like which a user wants to purchase) from theplurality of products, on the basis of the part preference informationfrom the user terminal 21 _(n).

That is, for example, the shop server 23 _(m) generates a classifier forclassifying whether each product is fit for the user preference, on thebasis of the part preference information from the user terminal 21 _(n),and searches the user desired product on the basis of the generatedclassifier.

Further, the shop server 23 _(m) generates GUI information fordisplaying the search result obtained by the search, and supplies theresult to the user terminal 21, through the network 22.

Further, the shop server 23 _(m) shares the classifier with a differentshop server 23 _(m)′, for example. Details about the shop server 23 _(m)will be described later with reference to FIGS. 7 to 13.

The classifier shared server 24 is connected to, for example, the shopservers 23 ₁ to 23 _(M) through the network 22. Here, the classifiershared server 24 may be included as a component of an arbitrary shopserver 23 _(m).

The classifier shared server 24 stores (retains) the classifiergenerated by the shop server 23 _(m), for example. The classifier storedin the classifier shared server 24 is appropriately shared with theplurality of shop servers 23 _(m).

That is, for example, the classifier shared server 24 stores a table 24a in which a classifier for searching the desired product from theplurality of products which are targets for search is related to eachuser ID for uniquely classifying each user of the user terminal 21 _(n),as shown in FIG. 2.

Next, FIG. 2 illustrates an example of the table 24 a stored in theclassifier shared server 24.

For example, a classifier m1 generated in a shop server 23 _(m1) thatspecializes in selling cute-style dresses, a classifier m2 generated ina shop server 23 _(m2) that specializes in selling adult-style dresses,a classifier m3 generated in a shop server 23 _(m3) that specializes inselling cute camisoles, and the like, which are related to a user ID“user1” for uniquely classifying a first user, are stored in the table24 a.

Further, for example, a classifier m1′ generated in a shop server 23_(m1′) that specializes in selling cute dresses, a classifier m2′generated in a shop server 23 _(m2′) that specializes in sellingadult-style dresses, and a classifier m3′ generated in a shop server 23_(m3′) that specializes in selling cute-style camisoles, which arerelated to a user ID “user2” for uniquely classifying a second userdifferent from the first user, are stored in the table 24 a.

The classifier m1 searches a product desired by the first user from theplurality of products “cute dresses” which are search targets, and isshared between the shop servers 23 _(m1) and 23 _(m1′) that specializein selling the “cute-style dresses”, for example.

Specifically, for example, the shop server 23 _(m1) or 23 _(m1′) eachperforms search on the basis of the classifier m1 stored in theclassifier shared server 24, according to access from the user terminal21 _(n) of the first user.

Further, in a case where a classifier is newly generated on the basis offeedback from the user terminal 21 _(n), the shop server 23 _(m1) or 23_(m1′) supplies the newly generated classifier to the classifier sharedserver 24 through the network 22, and stores the newly generatedclassifier as the classifier m1 through overwriting.

Similarly, the classifier m2 searches a product desired by the firstuser from the plurality of products “adult dresses” which are searchtargets, and is shared between the shop servers 23 _(m2) and 23 _(m2′)that specialize in selling “adult-sized dresses”, for example. Further,the classifier m3 searches a product desired by the first user from theplurality of products “cute camisoles” which are search targets, and isshared between the shop servers 23 _(m3) and 23 _(m3′) that specializein selling “cute-style camisoles”, for example. This is applied to theclassifiers m1′, m2′, and m3′, in a similar way.

For example, a sharing method of sharing the classifier m1 between theshop server 23 _(m1) and the shop server 23 _(m1′) will be describedlater with reference to a flowchart in FIG. 12. Further, a differentsharing method other than the sharing method of the classifier describedwith reference to FIG. 12 will be described later with reference to aflowchart of FIG. 13.

[Configuration Example of User Terminal 21 _(n)]

FIG. 3 illustrates a configuration example of the user terminal 21 _(n).

The user terminal 21 _(n) includes a communicating section 41, a displaycontrol section 42, a display section 43 having a display screen 43 a, acontrol section 44, an operating section 45 and a storing section 46.

The communicating section 41 supplies the GUI information which issupplied from the shop server 23 _(m) through the network 22 to thedisplay control section 42.

Further, the communicating section 41 supplies the part preferenceinformation from the control section 44, to the shop server 23 _(m)through the network 22.

The display control section 42 displays a part image of each product,for example, as a purchase screen display referenced by a user inproduct purchasing, on the display screen 43 a of the display section43, on the basis of the GUI information from the communicating section41. Details about the purchase screen display displayed on the displayscreen 43 a will be described later with reference to FIG. 4.

Further, the display control section 42 displays a check box or the likefor receiving a feedback operation from the user, in addition to theplurality of part images, for example, as a feedback screen displayreferenced by the user when the feedback operation is performed, on thedisplay screen 43 a of the display section 43, under the control of thecontrol section 44. Details about the feedback screen display displayedon the display screen 43 a will be described later with reference toFIG. 5.

The display section 43 is an LCD (Liquid Crystal Display) or the like,and displays the plurality of part images or the check box or the likeon the display screen 43 a under the control of the display controlsection 42.

As shown in FIG. 3, the display section 43 may be a component of theuser terminal 21 _(n), or may be independently installed without beingincluded as the component of the user terminal 21 _(n). In this case,the display control section 42 in the user terminal 21 _(n) and thedisplay section 43 which is installed outside the user terminal 21, areconnected through a cable or the like, for example.

The control section 44 controls the communication section 41 and thedisplay control section 42 by executing a control program which isstored in advance in the storing section 46, for example. Further, forexample, the control section 44 generates the part preferenceinformation on the basis of an operation signal from the operatingsection 45, and then supplies the result to the communicating section41.

The operating section 45 includes buttons or the like operated by theuser. For example, as a feedback operation is performed by the user, theoperating section 45 supplies an operation signal corresponding to thefeedback operation to the control section 44.

The storing section 46 stores in advance the control program or the liketo be executed by the control section 44. Further, for example, thestoring section 46 stores a user ID of a user who uses the user terminal21, or different data.

[One Example of Display Screen of Display Section 43]

Next, FIG. 4 illustrates a display example of the display screen 43 awhen the purchase screen display referenced in product purchasing isdisplayed.

On the display screen 43 a, a plurality of part informations, such aspart images 81 ₁, 81 ₂, 81 ₃, 82 ₁, 82 ₂, 82 ₃, 83 ₁, 83 ₂, 83 ₃, . . ., in which each part of clothes A, B, C, . . . is displayed as a productis disposed in a matrix format, on the basis of a fit axis 61 and a partaxis 62 (which will be described later). As the part information, forexample, a part image, such as an imaged image obtained by imaging eachpart, a thumbnail image obtained by reducing the imaged image, or thelike is employed, or a part text, such as one more text characters thelike is employed.

Here, the fit axis 61 represents a target fit which is the level of fitbetween each of the plurality of clothes and the user preference by afit order 1, 2, 3, and so on. This fit order is high as the target fitis high.

Further, the part axis 62 represents a name of each part of the clothes,for example. For example, a front surface 62 a, a rear surface 62 b anda chest 62 c are sequentially disposed from the top, in the order ofparts which are importantly considered in purchase of the clothes on thepart axis 62. The order of the parts may be changed according to theuser's operation. Further, the name of each part may be added or deletedaccording to the user operation. Addition or deletion of the nameaccording to the user operation will be described later with referenceto FIG. 14.

On the display screen 43 a in FIG. 4, the part images 81 ₁, 81 ₂ and 81₃ and a detail button 101 of the clothes A ranked as number one in thefit order are disposed in parallel, in a lower direction (in the figure)from the fit order “1” on the fit axis 61. The detail button 101 isoperated when detailed information of the clothes A (for example, thesize, cost or the like of the clothes) is to be displayed.

Similarly, on the display screen 43 a in FIG. 4, for example, the partimages 82 ₁, 82 ₂ and 82 ₃ and a detail button 102 of the clothes Branked as number two in the fit order are disposed in parallel, in alower direction (in the figure) from the fit order “2” on the fit axis61. Further, the part images 83 ₁, 83 ₂ and 83 ₃ and a detail button 103of the clothes C ranked as number three in the fit order are disposed inparallel, in a lower direction (in the figure) from the fit order “3” onthe fit axis 61.

Further, on the display screen 43 a in FIG. 4, the part images 81 ₁, 82₁ and 83 ₁ which display a part of each front surface portion of theclothes A, B, C and so on are disposed in a right direction (in thefigure) from the front surface 62 a on the part axis 62. Further, thepart images 81 ₂, 82 ₂ and 83 ₂ which display a part of each rearsurface portion of the clothes A, B, C and so on are disposed in a rightdirection (in the figure) from the rear surface 62 b on the part axis62. Further, the part images 81 ₃, 82 ₃ and 83 ₃ which display a part ofeach chest portion of the clothes A, B, C and so on are disposed in aright direction (in the figure) from the chest 62 c on the part axis 62.

For example, the user may perform a pressing operation of pressing thedetail button 101 using the operating section 45 so that detailedinformation about the clothes A corresponding thereto can be displayed.This is similarly applied to the detail buttons 102 and 103.

Further, when the user finds clothes that fit the user preference (forexample, satisfactory clothes) by referring to the detailed informationor the part images, the user can perform a procedure of purchasing theclothes on the display screen 43 a.

As shown in FIG. 4, the plurality of image parts 81 ₁, 81 ₂, 81 ₃, 82 ₁,82 ₂, 82 ₃, 83 ₁, 83 ₂, 83 ₃ and so on are displayed on the displayscreen 43 a, but a display method of the image parts is not limitedthereto.

That is, for example, among the plurality of part images shown in FIG.4, only part images of a predetermined number may be displayed on thedisplay screen 43 a. In this case, in order to display the part imageswhich are not displayed on the display screen 43 a on the display screen43 a, a scroll bar, a page sending button or the like for displaying thenext part image is installed.

Further, for example, on the display screen 43 a, instead of the scrollbar, the part image may be slid (moved) in the right and left directions(in the figure) for the part image of each part. However, in this case,for example, since the part image of which the fit order is not “1” maybe displayed below the fit order “1” on the fit axis 61 due to thesliding of the part image, it is preferable that the fit order on thefit axis 61 be added to each part image to be displayed.

Further, for example, as shown in FIG. 4, a configuration may beemployed in which part images corresponding to the fit orders 1, 2, 3 onthe fit axis 61 and so on are all displayed on the display screen 43 a,and only the part image corresponding to the fit order n is displayed.

Further, for example, as shown in FIG. 4, all of the part imagescorresponding to names of the respective parts on the part axis 62 maybe displayed on the display screen 43 a, or only the part imagescorresponding to the name of an arbitrary part may be displayed.

Further, for example, as shown in FIG. 4, the fit axis 61 and the partaxis 62 are displayed on the display screen 43 a, but at least one ofthe fit axis 61 and the part axis 62 may not be displayed.

The above-described part image display and the display of the fit axis61 and the part axis 62 may be changed according to a user operation.

[User Feedback]

Next, FIG. 5 illustrates a display example of the display screen 43 awhen the feedback screen referenced when the feedback operation isperformed by the user is displayed.

Since the same reference numerals are given to the same components ofthe display screen 43 a in FIG. 5 as the display screen 43 a in FIG. 4,detailed description thereof will be appropriately omitted.

That is, the display screen 43 a in FIG. 5 is the same as the displayscreen 43 a in FIG. 4 except that check boxes operated by the feedbackoperation of the user are disposed under each part image, and a searchbutton 121 is disposed in a right lower section thereof, instead of thedetail buttons 101 to 103.

Under the part image 81 ₁, a fit box 81 a ₁ and an unfit box 81 b ₁ aredisposed as the check boxes. The fit box 81 a ₁ is operated to add a fitlabel indicating that apart displayed in the part image 81 ₁ is fit forthe user preference to the part image 81 ₁. Further, the unfit box 81 b₁ is operated to add an unfit label indicating that a part displayed inthe part image 81 ₁ is unfit for the user preference to the part image81 ₁.

With respect to other part images, the fit box and the unfit box aredisposed in the same way as in the part image 81 ₁.

That is, for example, a fit box 81 a ₂ and an unfit box 81 b ₂ aredisposed under the part image 81 ₂, and a fit box 81 a ₃ and an unfitbox 81 b ₃ are disposed under the part image 81 ₃, respectively.Further, a fit box 82 a ₁ and an unfit box 82 b ₁ are disposed under thepart image 82 ₁, and a fit box 82 a ₂ and an unfit box 82 b ₂ aredisposed under the part image 82 ₂, and a fit box 82 a ₃ and an unfitbox 82 b ₃ are disposed under the part image 82 ₃, respectively.Further, a fit box 83 a ₁ and an unfit box 83 b ₁ are disposed under thepart image 83 ₁, and a fit box 83 a ₂ and an unfit box 83 b ₂ aredisposed under the part image 83 ₂, and a fit box 83 a ₃ and an unfitbox 83 b ₃ are disposed under the part image 83 ₃, respectively.

The user performs the feedback operation of assigning at least one ofthe fit label and the unfit label using the part in the part imagedisplayed on the display screen 43 a as a target, using the operatingsection 45.

That is, for example, in the case shown in FIG. 5, the user isinterested in purchasing the clothes including the part on the partimage 81 ₂ and the part on the part image 83 ₃.

Accordingly, as shown in FIG. 5, the user performs the feedbackoperation of checking the fit box 81 a ₂ of the part image 81 ₂ and thefit box 83 a ₃ of the part image 83 ₃, respectively.

Further, for example, the user may not be interested in purchasing ofthe clothes including the part on the part image 83 ₂.

Accordingly, as shown in FIG. 5, the user performs the feedbackoperation of checking the unfit box 83 b ₂ of the part image 83 ₂.

Further, in a state where the fit box 81 a ₂, the fit box 83 a ₃ and theunfit box 83 b ₂ are checked, the user performs a pressing operation ofpressing the search button 121 using the operating section 45.

According to the feedback operation or the pressing operation from theuser, the operating section 45 supplies an operation signalcorresponding thereto to the control section 44. Further, the controlsection 44 generates part preference information indicating that the fitlabels are added to the part image 81 ₂ and the part image 83 ₃, and theunfit label is added to the part image 83 ₂, on the basis of theoperation signal from the operating section 45, and supplies the partpreference information to the communicating section 41. Thecommunicating section 41 supplies the part preference information fromthe control section 44 to the shop server 23 _(m) through the network22.

The shop server 23 _(m) generates a classifier on the basis of the partpreference information supplied from the communicating section 41through the network 22. Further, the shop server 23 _(m) searches aproduct desired by the user (for example, a product which the user wantsto purchase), on the basis of the generated classifier.

[Operation of User Terminal 21 _(m)]

Next, a display control process performed by the user terminal 21 _(n)will be described with reference to a flowchart of FIG. 6.

For example, the display control process is started when an operation isperformed in which a user browses a product which is sold in the shopserver 23 _(m) which serves as an internet shop using the operatingsection 45 on the display screen 43 a. At this time, the control section44 reads the user ID stored in the storing section 46 according to theoperation signal from the operating section 45 and supplies the user IDto the communicating section 41.

Further, in step S1, the communicating section 41 transmits the user IDfrom the control section 44 to the shop server 23 _(m) through thenetwork 22, under the control of the control section 44.

In this regard, the shop server 23 _(m) determines whether a classifier(hereinafter, also referred to as a “search target classifier”) forsearching a desired product from the plurality of products which aresearch targets is present in the classifier shared server 24, using theuser ID supplied from the communicating section 41 through the network22.

The shop server 23 _(m) performs the search using the search targetclassifier in a case where it is determined that the search targetclassifier is present in the classifier shared server 24. Further, theshop server 23 _(m) generates GUI information indicating a search resultobtained as a result of the search, and supplies the GUI information tothe communicating section 41 through the network 22.

Further, in a case where it is determined that the search targetclassifier is not present in the classifier shared server 24, the shopserver 23 _(m) transmits a request signal which requires transmission ofa search key used for searching the product to the communicating section41 through the network 22.

In step S2, the communicating section 41 determines whether thetransmission of the search key is required, that is, whether the requestsignal is received or the GUI information is received from the shopserver 23 _(m) through the network 22, according to the user IDtransmission.

In step S2, in a case where it is determined that the request signal isreceived from the shop server 23 _(m) through the network 22, thecommunicating section 41 supplies the received request signal to thecontrol section 44, and then the routine proceeds to step S3.

In step S3, the control section 44 controls the display control section42 to display an input screen display which demands a search key inputon the display screen 43 a of the display section 43. As the search key,an inquiry image, which is input (selected) by the user, indicating thatit is a product similar to a desired product among a plurality ofinquiry images presented to the user terminal 21 _(n) a keyword, whichis input by the user, relating to the desired product, or the like isemployed.

Further, as the user performs the input operation of inputting thesearch key using the operating section 45, the operating section 45supplies the operation signal corresponding to the input operation ofthe user to the control section 44.

The control section 44 discerns the search key on the basis of theoperation signal from the operating section 45, and supplies the resultto the communicating section 41. The communicating section 41 transmitsthe search key from the control section 44 to the shop server 23 _(m)through the network 22.

In this regard, the shop server 23 _(m) performs search on the basis ofthe search key supplied from the communicating section 41 through thenetwork 22. Here, in a case where the search key is the inquiry image,the shop server 23 _(m) performs the search on the basis of an imagefeature amount of the inquiry image, and in a case where the search keyis the keyword, the shop server 23 _(m) performs the search using thekeyword as meta information.

The shop server 23 _(m) generates the GUI information for displaying thesearch result obtained by the search, and supplies the result to thecommunicating section 41 through the network 22.

Further, the communicating section 41 supplies the GUI informationsupplied from the shop server 23 _(m) through the network 22 to thedisplay control section 42, and then allows the routine to proceed tostep S4.

Further, in step S2, in a case where it is determined that thetransmission of the search key is not required, that is, in a case wherethe GUP information is received from the shop server 23 _(m) through thenetwork 22, the communicating section 41 supplies the received GUIinformation to the display control section 42, and then allows theroutine to proceed to step S4.

In step S4, the display control section 42 displays the purchase screendisplay as shown in FIG. 4 on the display screen 43 a on the basis ofthe GUI information from the communicating section 41.

Further, in a case it is determined that a screen change operation isperformed by the user on the basis of the operation signal from theoperating section 45, the control section 44 allows the routine toproceed to step S5, and controls the display control section 42 tochange the display of the display screen 43 a.

That is, in step S5, the display control section 42 changes the displayof the display screen 43 a to the feedback screen display from thepurchase screen display, as shown in FIG. 5, under the control of thecontrol section 44.

In step S6, the control section 44 determines whether labeling isperformed by the user, on the basis of the operation signal from theoperating section 45, and repeats the process of step S6 until it isdetermined that the labeling is performed.

That is, in step S6, the control section 44 determines whether the userperforms the feedback operation with reference to the feedback screendisplay on the display screen 43 a, and determines whether the userperforms the pressing operation of pressing the search button 121, onthe basis of the operation signal from the operating section 45.

In step S6, in a case where it is determined that the labeling isperformed by the user, the control section 44 allows the routine toproceed to step S7, and then generates part preference information onthe basis of the operation signal from the operating section 45 andsupplies the part preference information to the communicating section41.

In step S8, the communicating section 41 transmits the part preferenceinformation from the control section 44 to the shop server 23 _(m)through a network 22. In this regard, the shop server 23 _(m) generatesa classifier through statistic learning based on the part preferenceinformation transmitted through the network 22, and performs the searchusing the generated classifier. Further, the shop server 23 _(m)generates GUI information for indicating the search result obtained bythe search, and supplies the GUI information to the communicatingsection 41 through the network 22.

In step S9, the communicating section 41 supplies the GUI informationsupplied from the shop server 23 _(m) through the network 22 to thedisplay control section 42. The display control section 42 updates thefeedback screen display on the display screen 43 a to a new purchasescreen display on the basis of the GUI information from thecommunication section 41, and then allows the routine to return to stepS5 to repeat the same processes. The display control process is endedwhen an ending operation indicating ending of the display controlprocess is performed by the user, for example.

As described above, according to the display control process, bydisplaying the feedback screen as shown in FIG. 5 on the display screen43 a, the labeling is performed on each part of the product by thefeedback operation of the user.

Accordingly, the user terminal 21 _(n) can feed back more detailed userpreferences to the shop server 23 _(m) as the part preferenceinformation by the feedback operation of the user, compared with thecase where the labeling is performed to the product itself.

Thus, even in a case where the amount of the part preference informationfrom the user terminal 21 _(n) is relatively small, the shop server 23_(m) can generate the classifier with high search accuracy.

That is, for example, in the case where the labeling is performed to theproduct itself, it is difficult to know which part of the respectiveparts of the product is labeled. Thus, in this case, in the statisticlearning of generating a classifier, a large amount of labeled imagedata is required as teacher data.

On the other hand, in a case where the labeling is performed to eachpart of the product, it is clear which part is labeled. Accordingly, inthis case, by the statistic learning using a small amount of labeledpart images, it is possible to generate a classifier with high searchaccuracy.

Further, even in a case where the amount of the part preferenceinformation from the user terminal 21 _(n) is relatively small, sincethe shop server 23 _(m) can generate the classifier with high searchaccuracy, it is possible to reduce the feedback operation of the user,to thereby reduce the burden on the user.

Further, according to the display control process, since the purchasescreen display as shown in FIG. 4 is displayed on the display screen 43a, compared with the case of a product image display in which all theproducts are displayed, the user can compare different products in adetailed part unit.

[Configuration Example of Shop Server 23 _(m)]

Next, FIG. 7 illustrates a configuration example of the shop server 23_(m).

The shop server 23 _(m) includes a communicating section 141, an initialscreen generating section 142, a storing section 143, a classifiergenerating section 144, a fit calculating section 145, a GUI updatingsection 146 and a control section 147.

The communicating section 141 reads a classifier shared with a shopserver 23 _(m′), from the classifier shared server 24 through thenetwork 22, on the basis of the user ID supplied from the user terminal21 _(n) through the network 22, and supplies the classifier to the fitcalculating section 145.

Further, in a case where the classifier shared with the shop server 23_(m′) is not present in the classifier shared server 24, thecommunicating section 141 generates a request signal which requires fora search key, and then transmits the request signal to the user terminal21 _(n) through the network 22.

Further, according to the transmission of the request signal, thecommunicating section 141 supplies the search key supplied from the userterminal 21 _(n) through the network 22 to the initial screen generatingsection 142.

Further, the communicating section 141 supplies the part preferenceinformation supplied from the user terminal 21 _(n) through the network22, to the classifier generating section 144. Further, the communicatingsection 141 supplies the GUI information from the initial screengenerating section 142 or the GUI updating section 146 to the userterminal 21 _(n) through the network 22.

The initial screen generating section 142 generates a GUI for displayingan initial screen with respect to the accessed user terminal 21 _(n).That is, for example, the initial screen generating section 142 performssearch on the basis of the search key from the communicating section141, displays GUI information for displaying the search result obtainedby the search, and then supplies the GUI information to thecommunicating section 141.

The storing section 143 is a hard disk or the like, for example, andstores in advance the plurality of part images for each of the pluralityof products each of which is sold in the shop server 23 _(m).Specifically, for example, the storing section 143 stores in advance theplurality of part images (for example, part images 81 ₁ to 81 ₃, partimages 82 ₁ to 82 ₃, part images 83 ₁ to 83 ₃, and so on) in the clothesas a product.

Further, it is assumed that the storing section 143 stores a productimage of each product which is sold in the shop server 23 _(m). Theproduct image is used, for example, when the search is performed on thebasis of the search key, in the initial screen generating section 142.

The classifier generating section 144 may generate a classifier(function) using an SVM (Support Vector Machine), for example, on thebasis of the part preference information from the communicating section141, and supplies the classifier to the fit calculating section 145.Details of the SVM will be described later with reference to FIG. 8.

Here, the classifier generating section 144 may generate the classifierusing a Bayes classifier, boosting algorithm or the like, instead of theSVM.

The fit calculating section 145 calculates a part fit indicating thelevel that the part displayed in the part image is fit for the userpreference for each of the plurality of part images, on the basis of theclassifier from the classifier generating section 144 or the classifierfrom the communicating section 141.

Further, the fit calculating section 145 calculates a target fitindicating the level that the product which is a retireval target is fitfor the user preference on the basis of the part fit calculated for eachof the plurality of part images, and then supplies the result to the GUIupdating section 146.

Details of the process performed by the fit calculating section 145 willbe described later with reference to FIGS. 9 to 11.

The GUI updating section 146 generates GUI information for updating theGUI of the display screen 43 a in the accessing user terminal 21 _(n).

That is, for example, the GUI updating section 146 searches a productdesired by the user from the plurality of products on the basis of thetarget fit from the fit calculating section 145, generates GUIinformation for displaying the search result obtained by the search, andthen supplies the result to the communicating section 141.

The control section 147 controls the communicating section 141, theinitial screen generating section 142, the classifier generating section144, the fit calculating section 145 and the GUI updating section 146.

Next, FIG. 8 illustrates an example of a case where the classifiergenerating section 144 generates a classifier by the statistic learningusing the SVM.

In FIG. 8, for example, the classifier generating section 144 reads fourpart images (hereinafter, referred to as “positive images”) to which afit label is added and three part images (hereinafter, referred to as“negative images”) to which an unfit label is added, from the storingsection 143, on the basis of the part preference information from thecommunicating section 141.

FIG. 8 illustrates a coordinate plane defined by two axes of an X axisrepresenting an image feature amount x, and Y axis representing an imagefeature amount y. On the coordinate plane, four image feature amounts(x₁, y₁) to (x₄, y₄) which are respectively extracted from four positiveimages are disposed as four coordinates indicated by a circle sign.

Further, on the coordinate plane, three image feature amounts (x₅, y₅)to (x₇, y₇) which are respectively extracted from three negative imagesare disposed as three coordinates indicated by an X sign.

The classifier generating section 144 extracts the four image featureamounts (x_(x1), y₁) to (x₄, y₄) from the four positive images,respectively, and extracts the three image features (x₅, y₅) to (x₇, y₇)from the three negative images, respectively.

Further, the classifier generating section 144 determines a separatinghyperplane on the basis of seven image feature amounts (x₁, y₁) to (x₇,y₇). The separating hyperplane is determined so that a margin which is adistance between the separating hyperplane and the image feature amount(in the case of FIG. 8, (x₁, y₁) and (x₅, y₅)) called a support vector,which is disposed in the vicinity of the separating hyperplane ismaximized.

Further, the classifier generating section 144 generates a classifierwhich calculates the part fit for each of the plurality of part images,on the basis of the determined separating hyperplane, and then suppliesthe result to the fit calculating section 145.

Here, for ease of description, the classifier generating section 144generates one classifier as described with reference to FIG. 8.

However, the classifier generating section 144 may generate a pluralityof weak classifiers or may generate one classifier including thegenerated plurality of weak classifiers. Further, the classifiergenerating section 144 may generates a plurality of classifiers whichcalculates the part fit for each part image of a different part.

Next, an example in a case where the fit calculating section 145calculates a plurality of part fits P_(in) for each part of a target(search target) n, and calculates a target fit r_(n) of the target n onthe basis of the calculated plurality of part fits, will be describedwith reference to FIGS. 9 to 11.

The fit calculating section 145 calculates the part fit P_(in)indicating the fit level of the user preference and the part for each ofthe plurality of part images, on the basis of the classifier from theclassifier generating section 144.

That is, for example, the fit calculating section 145 calculates adistance between a coordinate point 161 of the image feature amount(x_(x1), y₁) and the separating hyperplane as the part fit of the partimage corresponding to the image feature amount (x₁, y₁). Further, forexample, the fit calculating section 145 calculates a multiplicationresult obtained by multiplying a distance between a coordinate point 162of the image feature amount (x₅, y₅) and the separating hyperplane by −1as the part fit of the part image corresponding to the image featureamount (x₅, y₅).

Further, the fit calculating section 145 calculates the target fit r_(n)for each target n using the next expression (1) on the basis of the partfit P_(in).

r_(n)=Σ w_(i)P_(in)   (1)

In expression (1), i=0, 1, 2, . . . , I, and n=0, 1, 2, 3, 4, . . . , N(different from the suffix n of the user terminal 21 _(n)). Further, Σrepresents a product-sum operation of w_(i) and P_(in), and a weightw_(i) is exp(−ai)=1/e^(ai). Further, a>0, and e represents a base ofnatural logarithm (exponential).

Specifically, for example, as shown in FIG. 9, the fit calculatingsection 145 calculates a target fit r₁ (=w₀P₀₁+w₁P₁₁+w₂P₂₁) of a target1, on the basis of a part fit P₀₁ of a part image 82 ₁, a part fit P₁₁of a part image 82 ₂, and a part fit P₂₁ of a part image 82 ₃. In FIG.9, i=0, 1, 2, . . . , and n=0, 1, 2, 3, 4, . . . , N.

The fit calculating section 145 supplies the target fits r₀, r₁, . . . ,r_(N) calculated for each of the targets 0, 1, . . . , N to the GUIupdating section 146.

The GUI updating section 146 generates the GUI information fordisplaying the part image so that the corresponding fit order on the fitaxis 61 is high as the target fits is high, on the basis of the targetfits r₀, r₁, . . . , r_(N) from the fit calculating section 145, andthen supplies the result to the communicating section 141.

Next, a processing example in a case where a part of the part images isnot present will be described with reference to FIG. 10.

For example, as shown in FIG. 10, in a case where a part image 84 ₂ isnot present, the fit calculating section 145 cannot calculate the partfit P₁₃ of the part image 84 ₂ using the classifier from thecommunicating section 141 or the classifier generating section 144. Thereason is that the classifier calculates the part fit P₁₃ on the basisof the part image 84 ₂.

In this case, for example, the fit calculating section 145 calculates anaverage value of the part fits P₁₀, P₁₁, P₁₂, P₁₄, . . . of therespective part images 81 ₂, 82 ₂, 83 ₂, 85 ₂, . . . in which the partsof the same rear surface portion are displayed, as the part fit P₁₃ ofthe part image 84 ₂.

Accordingly, for example, even in a case where the part image 84 ₂ isnot present, since it is possible to calculate the part fit P₁₃ of thepart image 84 ₂, it is possible to calculate the target fit r₃ of thetarget 3.

Further, for example, the fit calculating section 145 may convenientlytreat the part fit P₁₃ of the part image 84 ₂ which is not present, asan integer C (for example, 0), to thereby calculate the target fit r₃ ofthe target 3.

As described above, the fit calculating section 145 uses the weightw_(i) (=exp(−ai)) which is changed according to the part importance iwhen the target fit r_(n) is calculated, which is not limitative.

That is, for example, in the user terminal 21 _(n), the part to whichany one of the fit label and the unfit label is added may be given a lowimportance i by the user, and may set the weight w_(i) of thecorresponding part to 0.

Here, in FIG. 11, the fit label (indicated by a black frame) is added tothe part image 81 ₁ and the part image 82 ₁, and the unfit label(indicated by a white frame) is added to the part image 85 ₁.Accordingly, in the part images which display the parts of the frontsurface portion, the fit label or the unfit label is added three times.

Further, for example, the fit label is added to the part image 82 ₃ andthe part image 83 ₃. Accordingly, in the part images which display theparts of the chest portion, the fit label or the unfit label is addedtwo times.

However, in FIG. 11, the fit label or the unfit label is not added toany one of the part images 81 ₂, 82 ₂, 83 ₂, 84 ₂, 85 ₂, . . . , whichare surrounded by a solid line. Accordingly, in the part images whichdisplay the parts of the rear surface portion, the fit label or theunfit label is not added.

In the case as shown in FIG. 11, the fit calculating section 145 maycalculate the target fit r_(n) using the weight w₁ corresponding to theparts of the rear surface portion as 0.

Further, for example, the fit calculating section 145 may calculate thetarget fit r_(n) by changing the corresponding weight w_(i) to weightw_(i)′ (=k×w_(i)), for example, according to the addition times k of thefit label or the unfit label.

Specifically, for example, in the case as shown in FIG. 11, the fitcalculating section 145 calculates the target fit r_(n) by changingweight w₀ to weight w₀′ (=3×w₀), by changing weight w₁ to weight w₁′(=0×w₁), and by changing weight w₂ to weight w₂′ (=2×w₂), respectively.

[Operation of Shop Server 23 _(m)]

Next, a first fit calculation process performed by, for example, theshop server 23 _(m1) will be described with reference to a flowchart ofFIG. 12.

The shop server 23 _(m1) is a shop server that specializes in selling“cute-style dresses”, and shares the classifier m1 with the shop server23 _(m1) that similarly specializes in selling “cute-style dresses”. Theclassifier m1 is generated in the shop server 23 _(m1) or the shopserver 23 _(m1′) and is stored in the classifier shared server 24.

The first fit calculation process is started when the communication withthe user terminal 21 _(n) is started, for example.

In step S21, for example, the communicating section 141 receives theuser ID “user1” transmitted from the user terminal 21 _(n) operated bythe first user through the network 22.

In step S22, the communicating section 141 determines whether theclassifier m1 corresponding to the received user ID “user1” is stored inthe classifier shared server 24, with reference to the table 24 a of theclassifier shared server 24 which is connected through the network 22.

If it is determined in step S22 that the classifier m1 is not stored inthe classifier shared server 24, the communicating section 141 allowsthe routine to proceed to step S23. Further, the communicating section141 transmits a request signal which requests a search key to the userterminal 21 _(n) through the network 22, under the control of thecontrol section 147.

Instep S24, the communicating section 141 receives the search keytransmitted from the user terminal 21 _(n) through the network 22 andsupplies the search key to the initial screen generating section 142, asthe request signal is transmitted.

In step S25, the initial screen generating section 142 calculates thetarget fit of each product, on the basis of the search key from thecommunicating section 141.

That is, for example, in a case where the search key is an inquiryimage, the initial screen generating section 142 extracts an imagefeature amount from the inquiry image, and calculates the similaritybetween the extracted image feature amount and an image feature amountof a product image which displays the product as the target fit.

Further, for example, in a case where the search key is a keyword, theinitial screen generating section 142 calculates the target fit so thatthe target fit becomes high for the product displayed in the productimage having the keyword as meta information.

Further, the initial screen generating section 142 performs the searchof the product desired by the user on the basis of the target fitcalculated for each product, generates GUI information for displayingthe search result obtained by the search, and then supplies the resultto the communicating section 141.

In step S26, the communicating section 141 transmits the GUI informationfrom the initial screen generating section 142 to the user terminal 21_(n) through the network 22, and then allows the routine to proceed tostep S32. Thereafter, the search with higher search accuracy isperformed according to the feedback operation of the user. Processes ofstep S32 and thereafter will be described later.

Further, if it is determined in step S22 that the classifier m1 isstored in the classifier shared server 24, the communicating section 141reads the classifier m1 from the classifier shared server 24 through thenetwork 22, supplies the result to the fit calculating section 145, andthen allows the routine to proceed to step S27.

Instep S27, the fit calculating section 145 calculates the part fit foreach of the plurality of part images which are stored in the storingsection 143, on the basis of the classifier m1 from the communicatingsection 141, and allows the routine to proceed to step S28.

Instep S28, the fit calculating section 145 calculates the target fit ofeach product which is the search target, on the basis of the part fitfor each of the plurality of part images, calculated in the process ofstep S27, and then supplies the result to the GUI updating section 146.

In step S29, the GUI updating section 146 performs search on the basisof the target fit of each product from the fit calculating section 145.Further, in step S30, the GUI updating section 146 generates the GUIinformation for displaying the search result obtained by the search instep S29, and then supplies the result to the communicating section 141.

In step S31, the communicating section 141 transmits the GUI informationfrom the GUI updating section 146 to the user terminal 21 _(n) throughthe network 22, and then allows the routine to proceed to step S32.

In step S32, the communicating section 141 waits until the partpreference information is received from the user terminal 21 _(n)through the network 22. That is, as labeling is performed by the user inthe user terminal 21 _(n) and the search button 121 in FIG. 5 ispressed, the communicating section 141 waits until the part preferenceinformation is transmitted from the user terminal 21 _(n).

Further, in a case where the part preference information is receivedfrom the user terminal 21, through the network 22, the communicatingsection 141 supplies the received part preference information to theclassifier generating section 144, and then allows the routine toproceed to step S33.

In step S33, the classifier generating section 144 discerns the labeledpart image on the basis of the part preference information from thecommunicating section 141, generates (learns) a new classifier m1 on thebasis of the labeled part image, and then supplies the result to the fitcalculating section 145. The new classifier m1 is supplied to theclassifier shared server 24 from the classifier generating section 144through the communicating section 141 and the network 22, and is storedby overwriting.

Instep S34, the fit calculating section 145 calculates the part fit foreach of the plurality of part images stored in the storing section 143on the basis of the new classifier m1 from the classifier generatingsection 144, and then allows the routine to return to step S28.

Further, in step S28, the fit calculating section 145 calculates thetarget fit of each product on the basis of the part fit for each of theplurality of part images, calculated in the process of step S34,supplies the result to the GUI updating section 146. Then, the routineproceeds to step S29, to repeat the same processes thereafter. Forexample, the first fit calculation process is ended when thecommunication with the user terminal 21 _(n) is ended.

As described above, according to the first fit calculation process,since the classifier is generated on the basis of the part preferenceinformation indicating each labeled part from the user terminal 21 _(n),it is possible to generate the classifier with a small amount of partpreference information, compared with a case where entire preferenceinformation indicating the labeled product itself is used.

Further, in step S27, the shop server 23 _(m1) uses the classifier m1which is generated, for example, by the shop server 23 _(m1′) and isstored in the classifier shared server 24. Accordingly, the shop server23 _(m1) should not generate the classifier from the beginning, and itis possible to obtain a search result desired by the user, with lessfeedback operation of the user.

However, in the first fit calculation process, if it is determined instep S22 that the classifier m1 is not stored in the classifier sharedserver 24, the target fit is calculated on the basis of the search keyin steps S23 to S25.

However, if the classifier m1 is not stored, as described with referenceto FIG. 13, the classifier m2 of the search target which belongs to acategory which is similar to a category of each product which is thesearch target may be used instead of the search key, to therebycalculate the target fit.

[Other Operations of Shop Server 23 _(m)]

Next, a second fit calculation process performed, for example, by theshop server 23 _(m1) will be described with reference to a flowchart ofFIG. 13.

The second fit calculation process is different from the first fitcalculation process in that processes of steps S53 and S58 are newlyadded, but is the same as the first fit calculation process in the otherprocesses.

In steps S51 and S52, the same processes as in steps S21 and S22 in FIG.12 are performed, respectively. In a case where it is determined in stepS52 by the communicating section 141 that the classifier m1 is notstored in the classifier shared server 24, the routine proceeds to stepS53.

In step S53, the communicating section 141 determines whether theclassifier m2 is stored in the classifier shared server 24 withreference to the table 24 a of the classifier shared server 24 which isconnected through the network 22.

That is, the communicating section 141 determines whether the classifierm2 generated by the feedback operation which is performed for eachproduct of a category which is similar to a category “cute-styledresses” of each product which is the search target, that is, a similarcategory “adult-style dresses” which is common in that they are dressesis stored in the classifier shared server 24.

If it is determined in step S53 that the classifier m2 is not stored inthe classifier shared server 24, the communicating section 141 allowsthe routine to proceed to step S54. In steps S54 to S57, the sameprocesses as in steps S23 to S26 in FIG. 12 are performed.

In steps S59 to S66, the same processes as in steps S27 to S34 of FIG.12 are performed.

Further, if it is determined in step S53 that the classifier m2 isstored in the classifier shared server 24, the communicating section 141reads the classifier m2 from the classifier shared server 24 through thenetwork 22, supplies the classifier m2 to the fit calculating section145, and then allows the routine to proceed to step S58.

In step S58, the fit calculating section 145 calculates the part fit foreach of the plurality of part images stored in the storing section 143on the basis of the classifier m2 from the communicating section 141,and then allows the routine to proceed to step S60.

In step S60, the fit calculating section 145 calculates the target fitof each product on the basis of the part fit for each of the pluralityof part images, calculated in the process of step S58, and supplies thecalculated target fit to the GUI updating section 146. Thereafter, theroutine proceeds to step S61, and then the same processes are repeated.The second fit calculation process is ended when the communication withthe user terminal 21 _(n) is ended, for example.

As described above, according to the second fit calculation process,even in a case where the classifier m1 is not present in the classifiershared server 24, since it is possible to perform the search using theclassifier m2 without using the search key, it is possible to generateGUI information for displaying a product desired by the user, comparedwith a case where the search is performed using the search key.

In the second fit calculation process, in a case where the classifier m1is not stored, the classifier m2 which is completely stored is usedinstead of the classifier m1, but a plurality of classifiers may beused, for example.

That is, for example, the shop server 23 m ₁ may use the classifier m3of the target “cute camisoles” which is common in that they areclassified as cute, in addition to the classifier m2 of the target“adult-style dresses” which is common in that they are dresses.

In this case, for example, the search is performed on the basis of anaverage value (α+β)/2 of a target fit a which is calculated on the basisof the classifier m2 and a target fit β which is calculated on the basisof the classifier m3.

Accordingly, for example, even in a case where the target fit α does notappropriately represent the user preference, when the target fit β isrelatively fit for the user preference, it is possible to obtain thesearch result which is further fit for the user preference, comparedwith the search result using the target fit α.

As described above, in the first fit calculation process, the shopserver 23 _(m1) shares the classifier m1 which is completely stored inthe classifier shared server 24, with the shop server 23 _(m1′).Further, in the second fit calculation process, in a case where theclassifier m1 is not stored in the classifier shared server 24, the shopserver 23 _(m1) uses the classifier m2 with respect to a product groupwhich is similar to a product group which is the search target, insteadof the classifier m1.

Here, the shop server 23 _(m1) uses only the classifiers m1, m2 and m3which are stored corresponding to the user ID “user1” of the first user,in the first user of the accessing user terminal 21 _(n), but theclassifiers to be used are not limited thereto.

Further, for example, in a case where the first user purchases apredetermined product and presents the product to the second user, theclassifier m1′ may be used instead of the classifier m1 in the first fitcalculation process, but the classifiers m1′ and m2′ may be used insteadof the classifiers m1 and m2 in the second fit calculation process.

In this case, the shop server 23 _(m1) may generate GUI informationaccording to the preference of the second user, and may display thesearch result fit for the preference of the second user on the displayscreen 43 a of the user terminal 21 _(n) corresponding to the firstuser.

Thus, the first user may purchase the product fit for the preference ofthe second user while referencing the purchase screen display which isdisplayed on the display screen 43 a. In a case where an input operationof inputting the search key or the feedback operation is performed bythe first user in the user terminal 21 _(n), the input operation or thefeedback operation is performed in consideration of the preference ofthe second user instead of the preference of the first user.

Further, for example, in a case where the first user corresponding tothe user ID “user1” and the second user corresponding to the user ID“user2” jointly purchase the same product from the shop server 23 _(m1),the classifier m1′ in addition to the classifier m1 may be used.

In this case, the shop server 23 _(m1) may generate GUI informationaccording to the preference of the first user and the preference of thesecond user, to thereby display the search result fit for both of thepreference of the first user and the preference of the second user, onthe display screen 43 a of the user terminal 21 _(n).

Thus, the first user may purchase the product fit for the preferences ofthe first and second users, while referencing the purchase screendisplay displayed on the display screen 43 a. In the user terminal 21_(n), in a case where the input operation of inputting the search key orthe feedback operation is performed by the first user, the inputoperation or the feedback operation is performed in consideration of thepreference of the second user in addition to the preference of the firstuser.

[Change of Part Axis 62]

In the present embodiment, for example, as shown in FIG. 4, in the partaxis 62, the front surface 62 a, the rear surface 62 b and the chest 62c are sequentially disposed from the top in the figure, but the displayorder of the names of the parts is not limited thereto.

That is, for example, by operating the operating section 45 of the userterminal 21 _(n), it is possible to change the display order of thenames of the parts. According to this change, the arrangement of thepart images is changed. In another embodiment, the display order of thenames of the parts is in a priority order determined based on partpreference information from feedback from a user.

Further, for example, the user terminal 21 _(n) may display the names ofthe respective parts in the descending order of labeled times in therespective parts. This is because the labeling is frequently performedfor a part which is generally emphasized in product purchase in thefeedback operation of the user.

Specifically, for example, as shown in FIG. 11, in a case where threelabels are added to the part images of the front surface portion, nolabel is added to the part images of the rear surface portion, and twolabels are added to the part images of the chest portion, the importancebecomes high in the order of the front surface portion, the chestportion and the rear surface portion. Further, in the descending orderof the importance, the respective part images are rearranged.

Further, for example, the part images of the front surface portion, therear surface portion and the chest portion are displayed on the displayscreen 43 a in FIG. 4, but the parts displayed in the part images arenot limited to the front surface portion, the rear surface portion andthe chest portion. For example, the part images to be displayed may bechanged according to the user change operation.

Next, FIG. 14 illustrates an example in a case where the name on thepart axis 62 is added or deleted according to the user operation.

In FIG. 14, in order to clarify the target to be added or deleted by theuser operation, a prime mark (′) is added to the sign. That is, in FIG.14, for example, a case where a chest 62 c′ on the part axis 62 is addedor deleted will be described.

On the display screen 43 a in FIG. 14, the front surface 62 a, the rearsurface 62 b and the chest 62 c′ are displayed on the part axis 62, andaccordingly, the part images 81 ₁, 82 ₁, 83 ₁, 81 ₂, 82 ₂, 83 ₂, 81 ₃′,82 ₃′, 83 ₃′, and so on are displayed.

In a case where the chest 62 c′ on the part axis 62 is deleted, forexample, from this state, the user performs an operation of dragging thechest 62 c′ and dropping the dragged chest 62 c′ over a dustbin 181using the operating section 45. Thus, the chest 62 c′ in the part image62 is deleted, and the part images 81 ₃′, 82 ₃′, 83 ₃′, and so on whichdisplay the chest portion are also deleted.

Further, for example, in a case where the chest 62 c′ and the partimages 81 ₃′, 82 ₃′, 83 ₃′, and so on are added (restored), the userselects a part (part surrounded by a thick line in the part image 81 ₁)of the chest portion from the part image 81 ₁, using the operatingsection 45. Thus, the chest 62 c′ and the part images 81 ₃′, 82 ₃′, 83₃′, and so on are added.

The user selects the part of the chest portion from the part image 81 ₁,but may select a part which the user desires to add from a part image(for example, the part image 81 ₂, the part image 82 ₁, or the like)different from the part image 81 ₁.

Further, on the display screen 43 a in FIG. 14, for example, the partimage 81 ₁ is displayed as a selection image used for selecting a partto be added on the part axis 62, but a new selection image differentlyfrom the part image 81 ₁ may be displayed.

As the selection image, one selection image may be employed, or aplurality of selection images which respectively displays the respectiveparts may be employed to thereby allow the user to select a selectionimage which displays the part to be added from the plurality ofselection images.

Further, for example, as the selection image, a three-dimensional image(stereoscopic image) may be employed to select the part to be added fromthe three-dimensional image. In the three dimensional image, since theproduct is rotatably disposed in all directions in the three dimensionalimage according to the user operation, it is possible to add any part ofthe product which is the search target only using one three-dimensionalimage without using a plurality of selection images (two-dimensionalimages) which displays the respective parts.

2. Modification

In the present embodiment, for example, the purchase screen display asshown in FIG. 4 and the feedback screen display as shown in FIG. 5 aredisplayed as the different display screens 43 a, respectively, but thepurchase screen display and the feedback screen display may be displayedas the same display screen 43 a.

That is, for example, the display screen 43 a in FIG. 4 may be used asthe display screen 43 a to which the fit box, the unfit box, the searchbutton 121 shown in FIG. 5 are newly added.

Further, in the present embodiment, as the purchase screen display, theplurality of part images are displayed on the display screen 43 a, butthe plurality of product images which respectively display therespective products may be displayed according to the target fit,instead of the plurality of part images.

That is, in a case where at least the feedback operation is performed,the plurality of part images may be displayed on the display screen 43a, and in a case where the feedback operation is not performed, theplurality of part images may not be displayed.

Further, in the present embodiment, the user terminal 21 _(n) generatesthe part preference information on the basis of the explicit feedbackoperation of checking the fit box or the unfit box shown in FIG. 5, butmay generate the part preference information on the basis of an implicitfeedback operation.

That is, for example, in a case where the user performs an operation ofenlarging the part image 81 ₁ to be displayed, it is considered that theimplicit feedback operation that a fit label is added to the part in thepart image 81 ₁ is performed, and thus, it is possible to generate thepart preference information.

Further, in the present embodiment, the shop server 23 _(m) performs thesearch and the user terminal 21 _(n) displays the search result obtainedby the search on the display screen 43 a, but each configuration of theshop server 23 _(m) and the user terminal 21 _(n) is not limitedthereto.

That is, for example, the user terminal 21 _(n) itself may perform thesearch and may display the search result obtained by the search on thedisplay screen 43 a. Further, the shop server 23 _(m) may supply thepart image to be displayed on the display screen 43 a according to thedemand from the user terminal 21 _(n).

Specifically, for example, the display control section 42 of the userterminal 21 _(n) serves as functional blocks (for example, the initialscreen generating section 142, . . . , the GUI updating section 146, andthe like) for calculating the target fit. In this case, the displaycontrol section 42 calculates the target fit, and performs the search onthe basis of the calculated target fit. Further, the display controlsection 42 generates GUI information for displaying the search resultobtained by the search, and controls the display section 43 on the basisof the generated GUI information.

In the present embodiment, the clothes are employed as the searchtarget, but the search target is not limited thereto. That is, as thesearch target, anything can be employed as long as it includes aplurality of elements.

Specifically, for example, it is possible to employ shoes as the searchtarget. In this case, as respective parts of the search target, forexample, a front surface portion, a side surface portion, a bottomportion and the like of the shoes are employed.

Further, for example, a building may be employed as the search target.In this case, for example, an appearance, an entrance, a lounge and thelike of the building may be employed as respective parts of thebuilding.

Further, for example, as the search target, a set including a pluralityof related products may be employed. In this case, the plurality ofrelated products become the respective parts of the search target.

That is, for example, as the search target, a dining set including afork, a spoon and a plate may be employed. In this case, for example, aspart images which display the respective parts of the dining set, afirst part image which displays the fork, a second part image whichdisplays the spoon and a third part image which displays the plate maybe employed.

Further, for example, a plurality of sub part images which respectivelydisplay the respective parts of the fork may be employed, instead of thefirst part image. This may be similarly applied to the second part imageand the third part image.

Further, for example, as the search target, instead of the dining set, atelevision set including a remote controller and a television receiver,a living room set including a sofa, a chair and a table, a suit setincluding a suit, a dress shirt, a necktie, and shoes, or the like maybe used.

Further, for example, as the search target, a still image may beemployed. In this case, for example, the respective areas on the stillimage may be employed as respective parts of the still image.

Further, for example, as the search target, a moving image including aplurality of images may be employed. In this case, for example, abeginning scene, a mid scene, a final scene and the like in the movingimage may be employed as respective parts of the moving image. Further,as the part images, images (for example, images optimally indicatingcontent of the scene, from the respective images which forms the scene)which respectively represent the beginning scene, the mid scene and thefinal scene may be employed.

Further, for example, as the search target, music or the like may beemployed. In this case, for example, part images which respectivelydisplay a part of lyrics of the music as characters are displayed on thedisplay screen 43 a.

Further, a reproduction button or the like for reproducing the part ofthe lyrics displayed in the part image as sound around the part imagemay be installed on the display screen 43 a. Furthermore, a reproductionbutton or the like for reproducing, as sound, each part of thecorresponding lyrics as the part image may be disposed on the displayscreen 43 a.

Further, for example, in a case where the music is formed of a pluralityof sounds obtained by playing the guitar, drum and base, respectively, areproduction button or the like for respectively reproducing the guitarsound, the drum sound and the base sound may be displayed as the partimage.

Ina case where the music is employed as the search target, a classifiermay be generated on the basis of a sound feature amount extracted fromsound (for example, guitar sound or the like) corresponding to thelabeled part image.

Further, a music video (promotion video) or the like which includesmusic and a moving image may be employed as the search target. In thiscase, at least one of the part image displayed when the music isemployed or the part image displayed when the moving image is employedis displayed on the display screen 43 a.

However, the series of processes as described above may be performed byhardware, or may be performed by software. In a case where the series ofprocesses is performed by software, a program which forms the softwareis installed, from a program recording medium, in a computer mounted indedicated hardware, a general-purpose computer or the like which isinstalled with a variety of programs to be able to perform a variety offunctions, for example.

[Configuration Example of Computer]

FIG. 15 is a block diagram illustrating a configuration example ofhardware of a computer which executes the above-described series ofprocesses by programs.

A CPU (Central Processing Unit) 201 executes a variety of processesaccording to programs stored in a ROM (Read Only Memory) 202 or astoring section 208. Programs, data, or the like to be executed by theCPU 201 are appropriately stored in a RAM (Random Access Memory) 203.The CPU 201, the ROM 202 and the RAM 203 are connected to each other bya bus 204.

An input and output interface 205 is connected to the CPU 201 throughthe bus 204. An input section 206 including a keyboard, a mouse, amicrophone or the like, and an output section 207 including a display, aspeaker or the like are connected to the input and output interface 205.The CPU 201 performs a variety of processes according to commands inputfrom the input section 206. Further, the CPU 201 outputs the processresult to the output section 207.

The storing section 208 which is connected to the input and outputinterface 205 includes a hard disk, for example, and stores programs tobe executed by the CPU 201 or a variety of data. A communicating section209 performs communication with external apparatuses through a networksuch as the Internet or a local area network.

Further, programs may be obtained through the communication section 209,and may be stored in the storing section 208.

When a removable media 211 such as a magnetic disk, an optical disc, amagneto-optical disc, a semiconductor memory or the like is installed, adrive 210 connected to the input and output interface 205 drives theremovable media 211, and obtains programs, data or the like recordedthereon. The obtained programs or data are transmitted to and stored inthe storing section 208 as necessary.

The recording medium which records (stores) the programs which areinstalled in the computer and can be executed by the computer includesthe removable media 211 which is a package media including a magneticdisk (including a flexible disc), an optical disc (CD-ROM (CompactDisc-Read Only Memory), DVD (Digital Versatile Disc)), a magneto-opticaldisc (MD (Mini-Disc)), a semiconductor memory or the like, the ROM 202in which the programs are temporarily or permanently stored, a hard diskwhich forms the storing section 208, or the like, as shown in FIG. 15.Recording of the programs to the recording medium is performed by awired or wireless communication medium called a local area network, theInternet, digital satellite broadcasting, through the communicationsection 209 which is an interface such as a router, a modem or the like,as necessary.

In this description, the steps corresponding to the series of processesas described above may be performed in a time series manner, or may beperformed in parallel or individually.

Further, in this description, the system refers to an entire systemincluding a plurality of devices or apparatuses.

Further, the present disclosure is not limited to the above-describedembodiments, and may have a variety of modifications without departingfrom the spirit of the present disclosure.

1. (canceled)
 2. A search apparatus comprising: circuitry configured to:receive feedback information to a portion of a first product from a userinput, wherein a plurality of portions including the portion of thefirst product is displayed on a display ordered by fit order; and searchinformation of a second product based on the feedback information to theportion of the first product.
 3. The search apparatus of claim 2,wherein the first product includes clothes.
 4. The search apparatus ofclaim 2, wherein the portion of the first product includes a part imageof the product.
 5. The search apparatus of claim 2, wherein thecircuitry is configured to cause display of portions information of theinformation of the second product on a basis of a first axis, respectivesecond portions to which the portions information correspond and asecond axis, the second axis intersecting the first axis.
 6. The searchapparatus of claim 5, wherein at least one of the portions informationincludes a text character.
 7. The search apparatus of claim 5, whereinat least one of the portions information includes an image.
 8. Thesearch apparatus of claim 5, wherein the portions information aredisplayed on a basis of the respective second portions to which theportions information correspond ordered by another fit order.
 9. Thesearch apparatus of claim 5, wherein names of the portions informationare displayed in a priority order determined based on portion preferenceinformation from the feedback information to the portion of the firstproduct.
 10. The search apparatus of claim 2, wherein the search uses aclassifier generated based on the feedback information to the portion ofthe first product.
 11. The search apparatus of claim 2, wherein thecircuitry is configured to calculate: first level information of whetherthe portions are fit for a user preference based on the feedbackinformation to the portion of the first product, and second levelinformation of whether the portions are fit for the user preferencebased on the first level information; and wherein a search result of thesearch is based on the second level information.
 12. The searchapparatus of claim 2, wherein the circuitry is configured to control thesearch of second portions of the second product based on the feedbackinformation to the portion of the first product, the feedbackinformation to the portion of the first product indicating whether agiven portion of the plurality of portions is fit for a user preference,and wherein, for each of the plurality of portions, portion informationthereof is displayed at a client terminal from which the feedbackinformation to the portion of the first product is received in an orderbased on second feedback information.
 13. The search apparatus of claim12, wherein at least one of the displayed portions information includesa text character.
 14. The search apparatus of claim 12, wherein at leastone of the displayed portions information includes an image.
 15. Amethod of searching comprising: receiving, by circuitry, feedbackinformation to a portion of a first product from a user input, wherein aplurality of portions including the portion of the first product isdisplayed on a display ordered by fit order; and searching, by thecircuitry, information of a second product based on the feedbackinformation to the portion of the first product.
 16. A non-transitoryrecording medium recorded with a computer readable program executable bya computer, the program comprising: receiving feedback information to aportion of a first product from a user input, wherein a plurality ofportions including the portion of the first product is displayed on adisplay ordered by fit order; and searching, by the circuitry,information of a second product based on the feedback information to theportion of the first product.